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Keypecking  by  seven  pigeons  was  established  and  maintained  on  a  multiple 

variable  ratio  (VR),  VR  schedule  of  food  presentation.  The  schedule  in  one  of  the 

components  was  then  changed  to  continuous  reinforcement  (CRF)  for  a  predetermined 

number  of  reinforcers.  Both  components  were  then  changed  to  extinction  (i.e.,  multiple 

extinction,  extinction).  This  sequence  was  repeated  for  a  varied  number  of  times  for  each 

pigeon  in  order  to  determine  the  relationship  between  the  number  of  reinforcers  delivered 

during  each  component  of  the  multiple  VR,  CRF  schedule  and  responding  during 

extinction.  For  most  pigeons  there  were  fewer  responses  during  extinction  in  the  presence 

of  a  stimulus  recently  paired  with  CRF,  regardless  of  the  number  of  reinforcers  received  in 

that  component.    The  ratio  of  the  total  responses  in  extinction  in  the  former  VR 

reinforcement  component  to  the  total  responses  in  the  CRF  component  increased  as  the 

number  of  reinforcers  delivered  during  each  component  of  the  multiple  schedule  increased. 

This  ratio  measure  of  the  extinction  performances  provided  an  estimate  of  the  magnitude  of 

the  partial  reinforcement  extinction  effect  (PREE)  which  was  reproduced  consistently  both 
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between  and  within  subjects.  Within-subject  replications  of  the  FREE  generally  occurred 
without  an  overall  reduction  in  the  number  of  responses  with  repeated  exposures  to 
extinction.  The  rate  of  change  in  response  rate  during  extinction  was  highly  variable  within 
and  across  subjects  when  the  multiple  VR,  CRF  exposure  was  less  than  1500  reinforcers 
per  component.  Exposure  to  more  than  1500  reinforcers  per  component  during  the 
multiple  VR.  CRF  schedule  resulted  in  roughly  equal  rates  of  change  for  the  two 
components.  These  data  confirm  the  existence  of  a  FREE  in  individual  pigeons  and  that  the 
effect  can  be  reproduced  within  subjects.  Further,  these  data  suggest  that  with  sufficient 
training  between  exposures  to  extinction,  the  repeated-extinction  effect  can  be  minimized  or 
eliminated. 


INTRODUCTION 

The  "persistence"  of  behavior  after  the  discontinuation  of  reinforcement  is 
considered  important  to  the  survival  of  an  organism  in  an  ever-changing  environment 
(Skinner,  1938).  In  a  world  in  which  access  to  food,  water,  and  sexual  partners  does  not 
always  occur  reliably,  organisms  that  continue  to  respond  after  several  unsuccessful 
attempts  at  obtaining  these  commodities  may  have  a  selective  advantage  compared  to 
organisms  who  "give  up"  if  the  persistence  eventually  leads  to  obtaining  the  required 
commodity.  Persistent  responding  when  a  resource  has  been  used  up  (e.g.,  over  fishing  a 
small  pond)  could  also  be  detrimental  if  it  prevented  the  organism  from  going  on  to  more 
profitable  activities  (e.g.,  searching  a  bush  for  berries).  Any  general  theory  of  behavior 
must  be  able  to  explain  the  persistence  or  lack  of  persistence  in  behavior  when 
contingencies  for  that  behavior  have  changed.  Of  equal  importance  is  that  an  understanding 
of  the  variables  that  affect  persistence  will  serve  as  a  powerful  tool  in  the  application  of  a 
behavioral  technology.  The  present  experiment  is  an  analysis  of  a  procedure  designed  to 
examine  the  effect  of  some  of  the  possible  controlhng  variables  in  the  persistence  of 
behavior  in  a  single  organism. 

The  usual  method  of  examining  the  effects  of  intermittent  reinforcement  on 
persistence  is  the  between-group  comparison  (see  Jenkins  &  Stanley,  1950,  for  a  review). 
Separate  groups  of  subjects  are  exposed  to  different  schedules  of  reinforcement  which  are 
then  followed  by  the  withdrawal  of  reinforcement.  The  usual  result  is  a  robust  effect  called 
the  partial  reinforcement  extinction  effect  (FREE).  The  FREE  describes  the  greater 
persistence  in  responding  during  extinction  following  a  history  of  partial,  or  intermittent, 
reinforcement  (FRF)  compared  to  a  history  in  which  each  response  is  reinforced  or 
continuous  reinforcement  (CRF).  The  simplest  schedule  of  reinforcement  in  an 
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experimental  setting  is  CRF,  which  specifies  that  a  reinforcer  is  presented  after  every 
instance  of  a  specified  operant  response  class.  More  complex  schedules  are  referred  to  as 
intermittent  or  partial  schedules  under  which  reinforcers  are  delivered  after  only  some 
responses.  Extinction  (EXT)  of  operant  behavior  is  the  procedure  of  discontinuing 
reinforcement  of  a  specified  operant  response  class  (Iversen  &  Lattal,  1991).  The  terni  is 
also  used  to  describe  the  process  of  the  reduction  in  the  frequency  of  the  operant  response 
class  resulting  from  the  extinction  procedure  (Iversen  &  Lattal.  1991 ). 

Use  of  separate  groups  of  subjects  usually  produces  the  FREE,  but  attempts  to 
generate  the  FREE  in  individual  subjects  have  met  with  difficulty.  One  method  of 
comparing  the  effects  of  continuous  and  intermittent  reinforcement  histories  within  an 
organism  is  to  expose  that  organism  to  both  CRF  and  FRF  at  different  times  during  the 
acquisition  procedure.  Each  schedule  of  reinforcement  can  be  presented  with  a  different 
discriminative  stimulus.  The  different  discriminative  stimuli  are  then  presented  at  different 
times  without  reinforcement  during  the  extinction  phase  of  the  procedure. 

Many  of  the  previous  attempts  at  generating  a  within-subject  FREE  have  produced 
reversed  PREEs,  more  persistent  responding  after  CRF  compared  to  FRF  (Adams, 
Nemeth,  &  Favlik,  1982;  Nevin,  Mandell  &  Atak.  1983;  Favlik  &  Carlton.  1965;  Favlik, 
Carlton,  Lehr,  &  Henrickson,  1967).  One  possible  explanation  for  this  inconsistency  in 
the  results  of  between-subject  and  within-subject  procedures  involves  the  practice  of 
maintaining  equal  temporal  exposure  to  discriminative  stimuli  associated  with  FRF  and 
CRF,  but  at  the  same  time  presenting  fewer  reinforcers  under  the  FRF  schedule  compared 
to  the  CRF  schedule  (e.g.,  Adams,  Nemeth,  &  Favlik,  1982;  Nevin,  Mandell,  &  Atak, 
1983;  Favlik  &  Carlton,  1965;  Favlik,  Carlton,  Lehr.  &  Henrickson,  1967).  The  present 
experiment  was  an  attempt  to  produce  the  FREE  within  a  single  organism  while  keeping  the 
number  of  reinforcers  delivered  during  FRF  and  CRF  equal. 

For  a  within-subject  procedure  to  succeed  in  producing  the  FREE,  stimuli  paired 
with  CRF  and  FRF  during  training  must  control  responding.  The  lack  of  stimulus  control 


3 
between  CRP  and  PRP  conditions  would  produce  an  effect  on  extinction  responding  akin 
to  extinction  after  a  single  PRP  schedule.  A  possible  example  of  a  failure  of  stimulus 
control  can  be  seen  in  Rashotte,  Ross,  and  Amsel's  (1968)  assessment  of  the  effect  of  the 
overall  rate  of  reinforcement  for  a  within-subject  comparison.  Three  groups  of  rats  were 
exposed  to  two  runways,  one  painted  black  on  the  left  and  white  on  the  right  and  the  other 
painted  in  the  reverse  pattern.  Each  runway  was  assigned  one  of  three  schedules  of 
reinforcement.  One  group  of  subjects  received  reinforcers  on  50%  of  the  trials  in  one 
runway  and  100%  of  the  trials  in  the  other  runway  (50/100  group).    Another  group  of 
subjects  received  reinforcers  on  50%  of  the  trials  in  both  runways  (50/50  group).  The  last 
group  of  subjects  received  reinforcers  on  75%  of  the  trials  in  both  runways  (75/75  group). 
The  50/100  group  and  the  75/75  group  received  the  same  overall  rate  of  reinforcement  of 
75%,  whereas  the  50/50  group  received  an  overall  rate  of  reinforcement  of  50%.  No 
differences  were  seen  between  the  mean  alley  speeds  for  the  two  runways  in  the  last 
acquisition  block  (i.e.,  2  trials  in  each  alley)  for  any  group.  All  groups  showed  no 
differences  in  reduction  in  mean  alley  speeds  during  extinction  between  the  two  runways. 
Comparisons  among  the  groups  revealed  that  the  speeds  during  extinction  of  the  50/50 
group  (i.e.,  50%  overall)  took  longer  to  decrease  than  those  of  the  50/100  and  75/75 
groups  (i.e.,  75%  overall),  which  decreased  at  a  similar  rate.  These  results  may  be 
interpreted  as  a  lack  of  stimulus  control  by  the  stimuli  associated  with  the  different 
schedules  of  reinforcement.  The  50/100  group  was  a  standard  within-subject  FREE 
procedure  but  it  produced  results  similar  to  the  75/75  group  due  to  a  lack  of  stimulus 
control  by  the  runway  paint  pattern  for  the  individual  schedules  of  reinforcement. 

Several  experimenters  have  attempted  to  generate  a  within-subject  FREE  by 
accentuating  the  stimulus  differences  associated  with  the  CRP  and  FRF  schedules. 
Rashotte  (1968)  required  rats  to  emit  the  same  response  (running)  for  both  schedules  or 
different  responses  (running  and  climbing)  for  each  schedule.  He  found  a  FREE  if  the 
responses  were  the  same,  but  the  magnitude  of  the  FREE  was  increased  by  requiring 
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different  responses  for  each  schedule.  Amsel.  Rashotte,  and  MacKinnon  (1966)  used 
different  colored  runways  (black  vs.  white)  and  were  unable  to  produce  a  FREE  when 
equating  the  number  of  reinforcers  (90)  or  the  number  of  trials  (84)  during  training.  They 
did,  however,  produce  a  small  FREE  after  exposing  subjects  to  160  trials  during  training. 
Rashotte  and  Amsel  (1968)  attempted  to  increase  stimulus  control  with  either  a  black  or 
white  runway  and  exposure  to  the  trials  (60)  during  either  the  morning  or  evening,  but  no 
FREE  was  produced.  Waters  and  Knott  (1970)  used  either  barehanded  vs.  glove  handled, 
noise  vs.  silence,  morning  vs.  evening,  and  the  construction  of  the  runways  as 
discriminative  stimuli  and  succeeded  in  producing  a  within-subject  FREE.  Feider  (1973) 
reported  that  groups  of  rats  required  to  respond  on  different  levers  showed  a  FREE, 
whereas  groups  that  had  to  responded  on  one  lever  showed  no  FREE. 

In  light  of  these  experiments,  particular  attention  must  be  paid  to  the  stimuli  used  in 
conjunction  with  the  schedules  of  reinforcement  if  a  within-subject  FREE  is  to  be 
reproduced.  The  preceding  experiments  concentrated  on  increasing  the  discriminability  of 
stimuli  associated  with  the  different  schedules  of  reinforcement.  Another  strategy  is  to  take 
advantage  of  an  organism's  susceptibility  to  stimulus  control  by  a  single  stimulus  modality 
(e.g.,  light  wave  frequency  in  the  case  of  pigeons.  Terrace,  1966).  Using  a  single 
response  in  the  presence  of  two  different  stimuli  of  the  same  modality  reduces  the  possible 
confounds  of  comparing  topographically  different  responses  (e.g.,  differences  in  effort  or 
time  to  complete  the  responses). 

In  the  present  experiment,  an  attempt  was  made  to  determine  the  function  relating 
the  number  of  CRF  reinforcers  presented  after  FRF  and  before  EXT  (i.e.,  interpolated 
CRF)  to  the  number  of  responses  made  during  EXT  to  determine  if  interpolating  a  period 
of  CRF  between  exposures  to  intermittent  reinforcement  and  extinction  would  accelerate 
extinction.  If  FRF  produces  more  persistence  during  extinction  then  CRF,  implementing  a 
schedule  of  CRF  after  FRF  just  before  attempting  to  extinguish  the  behavior  may  reduce 
persistence  of  responding  characteristic  of  intermittently  reinforced  behavior. 
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Results  from  early  experiments  examining  the  effects  of  combinations  of  CRF  and 
PRF  on  extinction  performances  have  been  mixed.  Many  of  the  earlier  experiments 
showed  no  reductions  in  extinction  performances  with  the  introduction  of  CRP  after  PRF 
(Jenkins,  1962;  Likely,  1958;  Quartermain  &  Vaughan,  1961;  Sutherland,  Mackintosh  & 
Wolfe,  1965;  Theios,  1962),  but  other  experiments  did  produce  a  reduction  in  persistence 
(Dyal  &  Sytsma,  1976;  Moreland,  Stalling  &  Walker,  1983;  Stalling,  Moreland,  Merrill  & 
Scotti,  1981). 

A  possible  explanation  for  the  differing  results  may  lie  in  the  method  used  to  assess 
the  effects  of  interpolated  CRF  on  extinction  performances  compared  to  extinction 
performances  after  PRF  alone.  For  example,  Jenkins  (1962,  Experiment  2)  compared  a 
group  of  pigeons  receiving  20  PRF  (50%)  trials  to  a  group  receiving  20  PRF  followed  by 
12  CRF  trials,  and  showed  no  significant  difference.  In  this  comparison,  the  number  of 
PRF  trials  was  equal  (20)  but  the  total  number  of  trials  and  reinforcers  were  not  equal  (20 
vs.  32  trials  and  10  vs.  24  reinforcers).  Comparing  the  20-PRF  group  to  another  group 
that  received  8-PRF-followed-by-12-CRF,  thereby  equating  the  number  of  trials,  showed  a 
decrease  in  responding  during  extinction  when  CRF  followed  PRF.  Comparison  of  the 
32-PRF  group  to  the  8-PRF-followed-by-12-CRF  group,  which  equated  the  number  of 
reinforcers.  also  showed  a  decrease  in  extinction  responding  with  interpolated  CRF. 

Jenkins'  (1962)  data,  along  with  data  from  other  experiments  (e.g.,  Hearst,  1961; 
Perin,  1942;  Williams,  1938;  Wilson,  1954)  have  shown  that  the  number  of  reinforcers 
delivered  during  training  can  have  a  pronounced  effect  upon  extinction  performance.  In 
order  to  compare  the  effects  of  CRF  and  PRF  under  equal  conditions  and  increase  the 
likelihood  of  producing  a  PREE,  the  present  experiment  was  designed  to  keep  the  number 
of  reinforcers  presented  during  CRF  and  PRF  equal. 

To  approximate  conditions  often  obser\'ed  in  natural  settings,  a  variable  ratio  (VR) 
schedule  was  selected  for  the  PRF  schedule.  Variable-ratio  schedules  are  simple  in 
comparison  to  the  many  possible  intermittent  reinforcement  schedules  found  in  nature,  but 
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the  strategy  of  the  present  experiment  was  to  create  an  intermittent  schedule  of 
reinforcement  under  controlled  conditions  without  introducing  such  additional  variables  as 
noncontingent  reinforcement  or  interresponse  lime  requirements. 

An  additional  goal  of  the  present  experiment  was  to  evaluate  the  use  of  different 
extinction  criteria  in  establishing  the  existence  of  the  FREE.    An  important  procedural 
consideration  is  the  decision  of  when  to  stop  measuring  behavior  during  extinction.  The 
extinction  criterion  chosen  should  allow  for  a  complete  picture  of  extinction  responding 
without  unduly  lengthening  the  experiment.  The  simplest  extinction  criterion  has  been  to 
conclude  the  procedure  after  a  predetermined  duration  (e.g.,  5  daily  40  min.  sessions, 
Margulies,  1961;  or  2  daily  20  min.  sessions,  Hearst.  1961).  Another  fairly  simple 
criterion  is  to  expose  the  subject  to  extinction  until  a  predetermined  amount  of  time  without 
a  response  has  occurred  (e.g.,  1  session  until  5  min.  without  a  response,  Perin.  1942; 
Williams,  1938).  The  time-without-a-response  criterion  could  also  be  used  with  repeated 
daily  sessions,  for  example.  5-min  daily  sessions  with  a  5-min-without-a-response 
criterion  (Hothersall,  1966)  or  more  simply,  one  session  without  a  response.  This 
experiment  employed  a  conservative  extinction  criterion,  thus  allowing  for  retrospective 
analyses  of  other  less  stringent  extinction  criteria. 

Nevin  (1974)  introduced  a  measure  of  response  strength  that  equated  response 
measures  generated  during  different  reinforcement  schedules.  With  respect  to  this 
measure,  the  schedule  with  the  higher  rate  of  reinforcement  generally  produced  behavior 
that  was  more  resistant  to  environmental  changes  that  followed.  Nevin's  theory  of 
behavioral  momentum  was  an  analogy  drawn  from  physics  that  emphasized  the  relationship 
between  external  variables,  response  strength  and  resistance  to  change.  Behavioral  mass 
(i.e.,  response  strength)  was  inferred  from  relative  changes  in  response  rate  when 
environmental  conditions  are  changed  (Nevin,  Mandell,  &  Atak,  1983).  Nevin's  theory 
predicts  that  CRF  would  produce  more  resistance  to  change  compared  to  PRE  (i.e.,  the 
reversed  PREE).  The  reversed  PREE  would  be  predicted  because  the  rate  of  reinforcement 
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for  CRP  is  usually  higher  than  for  PRF  and  the  higher  the  rate  of  reinforcement,  the  more 
resistant  behavior  becomes  to  environmental  changes  (e.g.,  extinction).  An  additional 
function  of  the  present  experiment  was  to  examine  the  rate  of  change  in  extinction 
respondmg  as  this  measure  was  affected  by  the  number  of  CRF  reinforcers. 


METHOD 

Subjects 
Seven  adult,  experimentally  naive,  male  White  Cameau  pigeons  (Columba  livia) 
were  housed  individually  in  a  colony  room  ( 16  hr.  light/8  hr.  dark).  They  had  continuous 
access  to  vitamin  enriched  water  and  health  grit.  Subjects  2374,  3180  and  3519  started  the 
experiment  at  809?-  of  their  free-feeding  weights,  but  were  later  reduced  to  70%  to  increase 
stability  of  responding  (see  below).  Subjects  2822,  2842,  2875  and  2880  were  maintained 
at  70%  of  their  free-feeding  weights  throughout  the  experiment.  Each  bird  was  fed  after 
the  experimental  session  as  necessary  to  maintain  the  desired  body-weight. 

Apparatus 

The  operant  conditioning  chamber  was  a  Lehigh  Valley  Electronics  (Model  1519c) 
unit  for  pigeons  with  workspace  dimensions  of  35.5  cm  x  30.5  cm  x  35.5  cm.  The 
chamber  was  fitted  with  a  three-key  display  board  (Model  132-02).  Three  response  keys, 
2.5  cm  in  diameter,  were  located  5.6  cm  from  each  other  and  23  cm  from  the  chamber  floor 
in  a  horizontal  row  on  the  display  wall.  Only  the  center  key  was  used  in  the  experiment.  A 
keypeck  with  a  force  greater  than  0. 1 8N  started  a  70-ms  tone  from  a  Sonalert®  (Model 
SC628).  The  Sonalert®  was  located  behind  the  front  wall  2.0  cm  from  the  floor.  The 
center  key  could  be  transilluminated  from  the  rear  by  a  white,  green  (G)  or  red  (R)  light. 
The  left  key  was  dark  and  inoperable  and  the  right  key  was  replaced  with  an  aluminum 
plate.  The  chamber  was  illuminated  by  a  1.2-W  bulb  (houselight)  5.5  cm  above  the  center 
key. 

During  operation  of  the  food  hopper,  pigeons  gained  access  to  mixed  grain  (5/10 
milo,  4/10  buckwheat,  1/10  hemp).  The  opening  to  the  food  hopper  was  5.7  by  5.2  cm  and 
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located  9.0  cm  below  the  center  key.  The  inside  of  the  food  hopper  was  illuminated  by  a 
1 .2-W  bulb  and  the  keylight  and  houselight  were  turned  off  during  food  presentations. 

The  chamber  was  kept  in  a  room  where  white  noise  was  continuously  present.  A 
custom-built  computer  (Walter  cS:  Palya.  1986)  was  mounted  in  a  metal  enclosure  on  top  of 
the  chamber.  The  computer  operated  under  the  ECBasic  control  system  (Walter  &  Palya. 
1986)  that  programmed  contingencies,  collected  data  and  interfaced  with  an  IBM- 
compatible  computer  (Zenith)  in  an  adjacent  room.  A  Gerbrands  (Model  C-3)  cumulative 
response  recorder  was  used  to  monitor  responding. 

Procedure 

Each  pigeon  was  placed  in  the  chamber  for  at  least  two  30-min  adaptation  sessions 
in  which  the  houselight  was  on  and  no  behavioral  contingencies  were  programmed.  Once  a 
pigeon  was  moving  around  the  chamber  consistently,  food  hopper  (magazine)  training 
began.  Initially,  the  houselight  was  off  and  the  hopper  was  raised  and  filled  with  mixed 
grain.  Once  a  pigeon  ate  from  the  hopper  for  10-15  s  the  hopper  was  lowered  (the 
houselight  turned  on)  and  raised  quickly.  The  hopper-presentation  duration  was  gradually 
shortened  to  3  s,  and  the  inter- food  interval  was  lengthened  to  an  average  of  1  min. 
Training  continued  until  pigeons  would  reliably  (and  with  short  latencies)  approach  and  eat 
from  the  hopper  from  anywhere  in  the  chamber. 

Keypecking  was  shaped  by  differentially  reinforcing  successive  approximations  to 
the  final  response.  The  key  was  illuminated  by  a  white  light  during  this  initial  training  of 
the  keypeck.  After  keypecking  was  maintained  for  two  sessions  of  CRF  (40  reinforcers 
per  session)  the  schedule  was  changed  to  a  multiple  CRF  (green  keylight),  CRF  (red 
keylight)  schedule  in  which  the  components  were  presented  in  simple  alternation,  lasted  for 
5  reinforcers,  and  were  separated  by  a  one  minute  time-out  (houselights  and  keylights 
turned  off)  between  the  components.  The  response  requirement  was  increased  gradually 
until  keypecking  was  maintained  on  two  equal  VR  schedules  for  both  the  green  and  red 
keylights.  Table  1  shows  the  terminal  VR  schedules  for  each  pigeon.  The  VR  schedules 


2822 

VRIOO 

VRIOO  or  CRF 

2875-1 

VRIOO 

VRIOO  or  CRF 

2875-2 

VR25 

VR25  or  CRF 

2875-3 

V'R25 

VR25  or  CRF 

2842 

VR50 

VR50  or  CRF 

3519 

\T^50 

VR50  or  CRF 

2374 

VRIOO 

VRIOO  or  CRF 

3180 

VRIOO  or  CRF 

VRIOO 

2880 

VR50  or  CRF 

VR50 
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were  constructed  by  randomly  selecting,  without  replacement,  \'alues  from  an  evenly 
distributed  list  of  25  numbers  ranging  from  1  to  twice  the  value  of  the  VR  schedule. 
Variable  ratio  values  of  50  and  25  were  used  for  some  pigeons  to  maintain  responding 
without  pauses  after  attempts  at  VRIOO  failed  to  do  so  consistently. 


Table  1. 

Schedules,  keylight  color  assignments  and  number  of  components  per  session. 

Green  Red  Number  of 

keylight  keylight  components/ 

Pigeon component component session 

8 
8 
8 
8 
8 

10 
10 
10 
8 

Note;  For  subject  2875  different  VR  schedules  were  used  between  the  first  extinction  series  and  the 
extinction  series  that  followed  (i.e.,  2  &  3). 


The  experiment  consisted  of  repeated  exposures  to  a  three-phase  series.  In  the  first 
phase  of  the  experiment  reinforcers  were  arranged  according  to  a  multiple  VR  VR  schedule 
(VR  VR).  When  stability  criteria  were  met  (see  below)  the  second  phase  was  implemented 
using  a  multiple  VR  CRF  schedule  of  reinforcement  (VR  CRF).  For  the  majority  of  the 
pigeons  the  VR  CRF  phase  continued  until  a  predetermined  number  of  reinforcers  was 
delivered.  The  VR  CRF  phase  for  Pigeons  2374,  series  1  and  2,  3519,  series  1  and  2,  and 
3 1 80,  series  1 ,  was  terminated  when  performances  had  reached  a  steady  state.  The  third 
phase  consisted  of  a  multiple  extinction,  extinction  (EXT  EXT)  schedule  and  was 
terminated  after  no  keypecking  occurred  for  5  daily  consecutive  sessions.  Table  2  shows 
the  number  of  sessions  for  each  phase  of  the  extinction  series  and  the  number  of  reinforcers 
for  phases  VR  VR  and  VR  CRF.  The  numbers  listed  below  each  pigeon's  identification 
number  indicates  the  extinction  series  in  the  order  in  which  it  was  presented  to  the  pigeon. 
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Due  to  experimental  errors  (exposure  to  VR  VR  or  VR  CRF  schedules  during 
extinction),  EXT  EXT  phases  for  2842-2,  3180-3,  3519-2,3,4  and  6  were  not  continued  to 
the  extinction  criterion  and  are  denoted  by  an  asterisk  (*).  An  equipment  failure  caused  a 
dimmer  green  keylight  to  be  presented  during  VR  CRF  and  EXT  EXT  of  extinction  series  1 
for  Pigeon  2880  and  extinction  series  4  for  Pigeon  3519.  This  keylight  stimulus  change 
occurred  13  and  24  sessions  before  changing  to  EXT  EXT,  respectively.  These  extinction 
series  are  denoted  by  a  "+."  The  data  for  subjects  exposed  to  experimental  errors  are 
presented  for  the  individual  subjects,  but  are  not  included  in  the  group  analyses. 

The  starting  component  of  the  multiple  schedule  for  each  phase  was  determined 
each  day  by  a  Gellermann  (1933)  series  (G,  R,  G,  G,  R,  G,  R,  R;  repeats).  Individual 
components  ended  after  5  reinforcer  presentations  and  the  session  ended  after  10  (5  of  each 
keylight  color)  or  8  (4  of  each  keylight  color)  components  (see  Table  1). 

The  duration  of  each  component  during  EXT  EXT  (Appendix  A)  was  calculated  in 
the  following  manner.  A  geometric  mean  of  the  duration  of  each  individual  component 
(e.g.,  5  red  and  5  green)  was  calculated  from  the  last  five  sessions  under  the  VR 
schedule.  For  some  extinction  series,  the  individual  geometric  means  for  each  of  the 
components  (e.g.,  5  green  and  5  red)  were  used  to  time  the  components  during  extinction 
(see  Appendix  A).  In  other  instances  the  component  durations  during  extinction  were  all 
the  same  for  each  color  (green  and  red)  and  were  based  on  the  arithmetic  average  across  the 
session  for  each  keylight  color  in  the  last  five  sessions  under  the  VR  schedule.  In  the 
remaining  cases,  the  longer  of  the  two  arithmetic  means  of  the  component  durations  was 
used  for  all  components  during  extinction  (see  Appendix  A).  The  rationale  for  the  first  two 
timing  procedures  was  done  to  minimize  the  differences  between  VR  CRF  and  EXT  EXT 
while  maintaining  relatively  equal  exposure  to  both  stimuli  during  extinction.  In  all  EXT 
EXT  phases  (except  2374-1),  the  two  components  of  the  multiple  schedule  were  either 
presented  for  equal  durations  or  the  stimulus  previously  paired  with  CRF  was  presented  for 
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a  longer  time  (see  Appendix  A).  Instances  of  longer  exposure  to  the  CRF  discriminative 
stimulus  during  extinction  were  done  to  provide  a  consen'ative  estimation  of  the  FREE. 


Table  2. 

Number  of  sessions  in  each  phase,  number  of  reinforcers  presented  during  the  VR  VR  and 

VR  CRF  phases,  and  total  number  of  responses  during  extinction  after  each  schedule. 


Number    of   Sessions 


Pigeon      VR    VR       VR    CRF       EXT  EXT 


Total    Reinforcers 
Per    Component 


VR    VR       VR    CRF 


Extinction 
Responses    After 


VR 


CRF 


2374 

1 

54 

2 

38 

2822 

1 

11 

2 

30 

2842 

1 

61 

*  2 

38 

3 

22 

4 

30 

2875 

1 

77 

2 

8 

3 

30 

2880 

+  1 

124 

2 

29 

3 

90 

3180 

1 

260 

2 

72 

*3 

69 

4 

24 

5 

18 

6 

30 

3519 

1 

40 

*  2 

50 

*3 

17 

+  *4 

19 

5 

14 

*6 

7 

7 

15 

130 
62 


45 
101 
150 

2 


29 
125 


91 
11 
63 


90 
23 
79 
49 
1 
0 


50 

12 

129 

90 

49 

1 

0 


27 
45 


72 
98 


jl 
15 
31 
77 


44 
69 


10 
37 
33 


42 
54 
30 
51 

63 

42 


26 
30 

48 
34 
32 
25 

72 


1350 

3250 

4767 

1805 

950 

1550 

1814 

1223 

220 

580 

11763 

10927 

600 

20 

5222 

5056 

1220 

900 

2979 

1952 

760 

2020 

1809 

1371 

440 

3000 

2447 

532 

600 

40 

1859 

1896 

1540 

580 

3470 

2129 

160 

2500 

3622 

1310 

600 

20 

1453 

2823 

2480 

1820 

3335 

417 

580 

220 

4419 

3145 

1800 

1260 

4398 

2973 

6500 

2250 

10371 

5202 

1800 

575 

14267 

9372 

1725 

1975 

20010 

9044 

600 

1225 

10275 

8535 

450 

25 

8899 

7358 

750 

0 

4331 

3193 

1000 

1250 

7292 

5321 

1250 

300 

5816 

4185 

425 

3225 

4608 

1841 

475 

2250 

3400 

1933 

350 

1225 

3642 

1987 

175 

25 

2979 

1708 

375 

0 

3251 

2987 

*  did  not  meet  5  session  extinction  criterion 
+  change  in  green  keylight  in  VR  CRF  phase. 
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After  responding  extinguished  during  the  EXT  EXT  schedule,  the  subject  was 
exposed  to  a  multiple  CRF  CRF  schedule  during  the  following  daily  session.  The  schedule 
of  reinforcement  was  then  adjusted  back  to  the  multiple  VR  VR  schedule  designated  in 
Table  1.  Retraining  consisted  of  incrementing  both  VR  schedules  (e.g.,  CRF,  VR2,  VR5, 
VRIO,  VR20,  VR50,  VR75,  VRIOO)  when  the  daily  cumulative  records  showed  consistent 
responding  without  pauses. 

If  a  pigeon  did  not  respond  within  approximately  5  min.  after  the  beginning  of  the 
multiple  CRF  CRF  session,  one  of  two  priming  procedures  was  used  to  generate 
responding.  The  first  procedure  consisted  of  operating  the  food  hopper  once  or  twice  for 
3s  independent  of  responding.  The  second  procedure  consisted  of  the  experimenter 
opening  the  chamber  door  and  pressing  the  lighted  center  key  with  his  finger.  A  few 
pigeons  began  keypecking  within  the  first  5  min.  of  the  multiple  CRF  CRF  and  the  rest  of 
the  pigeons  began  keypecking  after  one  of  the  two  priming  procedures. 

To  decrease  variability  in  responding  for  Pigeon  3 180,  the  hopper  duration  was 
changed  from  3s  to  2.5s  to  reduce  possible  satiation  effects  towards  the  end  of  daily 
sessions.  This  change  in  the  hopper  duration  occurred  before  the  first  extinction  series. 

Stability  Criteria 
Stability  criteria  were  employed  to  determine  when  to  change  phases  at  several 
points  in  the  experiment.  Stability  criteria  were  calculated  using  kappa  (K)  (Johnston  & 
Pennypacker,  1980)  and  celeration  (C)  (Lindsley,  1969;  cited  by  Johnston  &  Pennypacker, 
1980).  Celeration  is  computed  as  the  ratio  of  two  predicted  daily  response  frequencies 
separated  by  seven  days  and  is  based  upon  the  slope  of  the  least  squares  regression  lines 
for  the  last  5  sessions  of  a  phase.  The  unit  of  celeration  value  is  movements  (i.e., 
keypecks)/minute/week.    A  value  of  1 .00  indicates  no  change  in  trend.  Values  greater  than 
1 .00  designate  an  increasing  trend,  and  values  less  than  1 .00  indicate  a  decreasing  trend. 
Values  of  celeration  can  range  from  0  to  infinity.  The  greater  the  change  in  value  of 
celeration  from  1 .00,  the  greater  the  increase  or  decrease  in  the  rate  of  change  in  the 
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response  rate  measure.  Celeration  is  an  estimate  of  the  trend  in  the  average  daily  response 
rates  for  each  component  and  was  used  in  conjunction  with  kappa  to  determine  steady  state 
performance. 


n 


r2Z.  llnXi-InXj  I  1 

The  computation  formula  for  kappa  is:      analog  I   _l^j I 

L  n(n-l)  J 

For  any  data  set,  therefore,  kappa  may  be  regarded  as  the  geometric  mean  of  all  ratios 
(Xi/Xj)  where  Xi  is  greater  than  Xj.  Kappa  quantifies  the  variability  seen  in  the  repeated 
measures  of  behavior  independent  of  the  mean  of  the  data  sample.  This  characteristic  of 
kappa  makes  for  a  more  accurate  comparison  of  variability  between  low  and  high  response 
rates  (e.g.,  response  rates  produced  by  CRF  and  VRIOO  respectively).  Values  of  kappa 
range  from  1 .00  to  infinity.  The  larger  the  value  of  kappa,  the  greater  the  variability  in  the 
data  sample.  A  kappa  value  of  1.10,  for  example,  indicates  that  each  value  in  the  set 
deviates  from  every  other  value,  on  average,  by  10%. 

The  stability  criteria  were  arbitrarily  defined  as  celeration  values  between  0.90  and 
1.10  and  kappa  values  less  than  or  equal  to  1 .  10  for  each  component  (green  or  red)  of  the 
multiple  schedule.  Measurements  of  kappa  and  celeration  were  based  on  the  response  rates 
for  each  component  during  the  five  most  recent  consecutive  daily  sessions. 

In  the  VR  VR  phase  an  additional  stability  criterion,  the  Geometric  Mean  Ratio 
(GMR),  measured  the  equality  of  responding  between  the  two  VR  components  and  was 
computed  as  the  ratio  of  the  geometric  means  (GM)  of  the  response  rates  for  the  last  5 
sessions  for  each  component,  the  larger  geometric  mean  divided  by  the  smaller.  The  value 
of  the  GMR  could  range  from  1 .00  to  infinity.  The  larger  the  value  of  the  GMR,  the 
greater  the  difference  between  the  two  components.  Equivalence  between  the  two 
components  was  defined  as  a  GMR  value  less  than  or  equal  to  1.10.  The  values  of  kappa, 
celeration,  and  GMR  for  each  extinction  series  are  shown  in  Appendix  B. 

For  the  last  extinction  series  replication  for  Pigeons  2822,  2842,  3875,  2880  and 
3180,  changes  from  VR  VR  to  VR  CRF  occurred  after  approximately  30  sessions 
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independent  of  the  stability  criteria.  Due  to  the  focus  of  the  experiment  on  the  manipulation 
of  the  number  of  reinforcers  delivered  during  VR  CRF,  most  phase  changes  to  EXT  EXT 
had  to  be  made  independent  of  the  above  mentioned  stability  criteria  (see  Appendix  B). 

Extinction  Criterion 
The  EXT  EXT  phase  was  terminated  after  5  consecutive  daily  sessions  with  no 
responding  in  either  component. 


RESULTS 

Figure  1  shows  a  sample  of  the  cumulative  records  for  Pigeon  2875"s  first 
extinction  series.  This  series  was  randomly  chosen  from  those  series  showing  the  FREE. 
Keypecking  maintained  under  the  VRIOO  (Figure  1,  upper  left  record)  showed  consistently 
high  rates  with  occasional  short  pauses  following  reinforcement.  Variable-ratio 
performances  in  the  green  keylight  component  (event  pen  deflected  down)  remained 
unaffected  by  the  change  in  the  red  component  (event  pen  deflected  up)  from  a  VR  100 
schedule  to  a  CRF  schedule  (Figure  1.  upper  right  record).  The  lower  left  record  (Figure 
1)  shows  that  the  rate  of  keypecking  was  high  for  the  first  four  components  with  an  abrupt 
change  to  almost  no  keypecking  in  the  fifth  (green  keylight)  component.  Keypecking 
remained  at  a  near  zero  rate  for  the  sixth  component,  but  high  rates  of  keypecking  occurred 
again  throughout  the  seventh  component  (green  keylight)  only  to  return  to  near  zero  for  the 
final  component  of  the  session.  On  the  second  day  (Figure  1,  lower  right  record),  the 
session  started  with  the  red  keylight  component  and  keypecking  rates  were  high  for  the  first 
two  components.  Keypecks  occasionally  occurred  during  the  third  through  the  seventh 
component,  with  high  rates  of  keypecking  occurring  again,  halfway  through  the  last 
component  (green  keylight).  The  rate  of  keypecking  differed  from  previous  components  in 
that  responding  took  on  more  of  a  "break  and  run"  characteristic  seen  when  keypecking 
was  being  reinforced  on  the  VR  100  schedule. 

The  last  two  columns  in  Table  2'  show  the  number  of  responses  to  the  extinction 
criterion  made  in  the  presence  of  the  two  discriminative  stimuli  (i.e.,  red  or  green  keylight) 
previously  paired  most  recently  with  VR  or  CRF.  In  25  of  27  cases,  there  were  fewer  total 


Data  from  both  extinction  curves  from  2374  and  the  first  extinction  curve  from  3180  were  published  in  a 
master's  thesis  by  the  author. 
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responses  during  extinction  after  a  recent  CRF  history  than  after  a  VR  history.  Continuous 
reinforcement  on  two  occasions  produced  more  total  responses  during  extinction  when 
CRF  training  was  Umited  to  40  (2842-4)  or  20  (2875-3)  reinforcers. 

Figures  2  through  5  show  cumulative  extinction  curves  for  all  seven  pigeons. 
For  the  first  few  sessions  of  extinction  there  was  a  high  rate  of  responding  after  both  CRF 
and  VR  schedules.  The  VR  history  generally  would  occasion  a  high  rate  of  responding  for 
a  few  additional  sessions  before  tapering  off.  Significant  differences  generally  were  not 
seen  between  extinction  components  after  the  first  10  to  15  sessions  of  extinction. 
Responding  during  extinction  after  CRF  occasionally  would  temporarily  exceed 
responding  after  VR  (i.e..  Figure  2,  panel  3  (2875),  Figure  3,  panel  4  (2842);  Figure  5, 
panel  1,  2  and  5  (3519)),  but  this  effect  was  sustained  in  only  two  instances  (Figure  2, 
panel  3  (2875),  Figure  3,  panel  4  (2842)).  Pigeons  2875  and  2842  showed  higher 
numbers  of  responses  after  CRF  compared  to  VR  reinforcement  after  receiving  relatively 
few  reinforcers  during  the  previous  VR  CRF  phase  (20  and  40,  respectively). 

Figure  6  shows  the  total  keypecks  emitted  during  extinction  for  the  CRF  history 
component  (upper  panel)  and  for  the  VR  history  (middle  panel)  as  a  function  of  the 
presentation  order  of  the  extinction  series.  The  lower  panel  of  Figure  6  shows  the 
extinction  ratio  (i.e.,  total  responses  emitted  during  extinction  in  the  presence  of  the  VR 
discriminative  stimulus  divided  by  the  total  number  of  responses  emitted  during  extinction 
in  the  presence  of  the  CRF  discriminative  stimulus)  as  a  function  of  the  presentation  order 
of  the  extinction  series.  An  extinction  ratio  value  of  1 .00  indicates  no  difference  between 
the  extinction  performances  after  VR  and  CRF.  Extinction  ratio  values  greater  than  1 .00 
indicate  a  FREE.  Values  less  than  1 .00  indicate  the  opposite  effect,  a  reversed  FREE.  The 
larger  the  absolute  value  of  the  extinction  ratio  the  greater  the  differences  in  extinction 
performances  after  VR  and  CRF.  Results  showed  no  relationship  between  repeated- 
extinctions  and  total  keypecks  during  extinction  after  CRF  (r=-.08),  VR  reinforcement  (r=- 
.20)  or  the  extinction  ratio  (r=-.18). 
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Figure  7  shows  the  number  of  keypecks  emitted  during  the  extinction  component 
previously  paired  with  VR  reinforcement  (upper  left  panel)  and  CRP  (upper  right  panel)  as 
a  function  of  the  number  of  reinforcers  per  component  presented  during  VR  CRF.  The 
number  of  keypecks  emitted  during  the  extinction  component  previously  paired  with  VR 
reinforcement  as  a  function  of  the  number  of  reinforcers  per  component  presented  during 
both  the  VR  VR  and  VR  CRF  phases  is  shown  in  the  lower  left  panel  of  Figure  7.  These 
analyses  show  both  between-  and  within-subject  variation.  The  number  of  responses 
emitted  during  the  extinction  component  previously  paired  with  CRF  was  highly  variable. 
Pigeons  3180  and  3519  showed  no  systematic  effect  due  to  the  number  of  previous 
reinforcers  delivered  during  VR  CRF,  but  Pigeons  2842  and  2875  showed  decreases  as  the 
number  of  previous  reinforcers  during  VR  CRF  increased.    The  number  of  responses 
emitted  after  VR  reinforcement  was  also  highly  variable  and  showed  no  systematic 
relationship  (r  =  -.03)  to  number  of  reinforcers  per  component  presented  during  VR  CRF, 
nor  to  the  number  of  reinforcers  per  component  presented  during  VR  VR  and  VR  CRF 
combined  (r  =  .22).  The  extinction  series  for  Pigeons  2374,  2822  and  2880  were  only 
successfully  replicated  once,  making  interpretations  of  trends  for  their  individual  data 
impractical. 

Figure  8  shows  the  extinction  ratio  as  a  function  of  the  number  of  reinforcers  per 
component  presented  during  the  VR  CRF  phase.  In  the  present  experiment  the  extinction 
ratio  generally  increased  as  the  number  of  reinforcers  during  VR  CRF  increased  (b  =  .71,  r 
=  .83).  The  dotted  lines  in  Figure  7  represent  the  1.00  value  of  the  extinction  ratio  (i.e.,  no 
PREE).  The  dashed  lines  of  Figure  7  represent  the  extinction  ratio  for  the  extinction  series 
in  which  there  was  no  VR  CRF  phase  (3180-6  and  3519-7). 

Figure  9  shows  the  extinction  ratio  determined  by  six  different  extinction  criteria  as 
a  function  of  the  number  of  reinforcers  presented  during  VR  CRF.  Each  criterion  required 
a  continuous  period  of  time  without  a  response  (i.e.,  5  sessions,  1  session,  or  1 
component).  In  addition,  these  criteria  could  be  "linked"  to  both  components  of  the 
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Figure  2.  Cumulative  extinction  curves  for  Pigeons  2822,  2374,  and  2875.  The  ordinates 
show  the  total  number  of  responses  emitted  during  the  extinction  component  previously 
paired  with  VR  (solid)  and  CRF  (dotted).  Note  that  the  ordinates  change  for  each  pigeon. 
The  abscissa  shows  consecutive  daily  sessions  from  the  beginning  of  the  extinction  phase 
(EXT  EXT)  of  each  extinction  series.  Each  panel  number  corresponds  to  the  order  in 
which  the  extinction  series  were  presented  for  each  pigeon.  Below  the  panel  number  is 
the  number  of  reinforcers  per  component  delivered  during  VR  CRF.  The  "x"  is  the  value 
of  the  VR  schedule  used  during  the  VR  VR  and  VR  CRF  phases  of  the  individual 
extinction  series  (i.e.,  x  =  100  for  Pigeons  2822  and  2374  for  all  extinction  series:  for 
Pigeon  2875.  x  =  100  for  the  first  extinction  series  and  x  =  25  for  the  second  and  third 
extinction  series). 
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Figure  3.  Cumulative  extinction  curves  for  Pigeons  2842  and  2880.  The  ordinates  show 
the  total  number  of  responses  emitted  during  the  extinction  component  previously  paired 
with  VR  50  (solid)  and  CRF  (dotted).  The  abscissa  show  consecutive  daily  sessions  from 
the  beginning  of  the  extinction  phase  of  each  extinction  series.  Each  panel  number 
corresponds  to  the  order  in  which  the  extinction  series  were  presented  for  each  pigeon. 
Below  the  panel  number  is  the  number  of  reinforcers  per  component  delivered  during  VR 
CRF.  The  asterisk  "*"  in  panel  2  for  Pigeon  2842  designates  the  termination  of  the 
extinction  phase  before  reaching  the  extinction  criterion  (i.e.,  5  consecutive  sessions 
without  a  response  in  either  component).  The  plus  sign  "+"  in  panel  1  for  Pigeon  2880 
designates  an  apparatus  failure  (see  text)  during  VR  CRF  of  the  extinction  series. 
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Figure  4.  Cumulative  extinction  cun'es  for  Pigeon  3 180.  The  ordinates  show  the  total 
number  of  responses  emitted  during  the  extinction  component  previously  paired  with  VR 
100  (solid)  and  CRF  (dotted).  The  abscissa  show  consecutive  daily  sessions  from  the 
beginning  of  the  extinction  phase  of  each  extinction  series.  Each  panel  number 
corresponds  to  the  order  in  which  the  extinction  series  were  presented.  Below  the  panel 
number  is  the  number  of  reinforcers  per  component  delivered  during  VR  CRF.  The 
asterisk  "*"  in  panel  3  designates  the  termination  of  the  extinction  phase  before  reaching  the 
extinction  criterion. 


Figure  5.  Cumulative  extinction  curves  for  Pigeon  3519.  The  ordinates  express  the  total 
number  of  responses  emitted  during  the  extinction  component  previously  paired  with  VR 
50  (solid)  and  CRP  (dotted).  The  abscissa  expresses  consecutive  daily  sessions  from  the 
beginning  of  the  extinction  phase  of  each  extinction  series.  Each  panel  number 
corresponds  to  the  order  in  which  the  extinction  series  were  presented.  Below  the  panel 
number  is  the  number  of  reinforcers  per  component  delivered  during  VR  CRF.  The 
asterisks  "*"  in  panels  2.  3.  4  and  6  designate  the  termmation  of  the  extinction  phase 
before  reaching  the  extinction  criterion.  The  plus  sign  "+"  in  panel  4  designates  an 
apparatus  failure  during  VR  CRF  of  the  extinction  series. 
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Figure  6.  Total  keypecks  in  extinction  after  CRP  (upper  panel)  and  total  keypecks  in 
extinction  after  VR  reinforcement  (middle  panel)  as  a  function  of  the  presentation  order  of 
the  extinction  series.  The  lower  panel  shows  the  extinction  ratio  as  a  function  of  the 
presentation  order  of  the  extinction  series.  Each  panel  shows  the  data  points  for  all 
extinction  series  except  those  not  meeting  the  extinction  criterion  as  well  as  those  following 
an  apparatus  failure  during  VR  CRF.  "r"  is  Pearson's  r  and  "b"  is  the  slope  of  the 
regression  line  (method  of  least  squares). 
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Figure  7.  Total  keypecks  in  extinction  after  VR  reinforcement  (upper  left  panel)  and  total 
responses  during  extinction  after  CRP  (upper  right  panel)  for  each  extinction  series  as  a 
function  of  the  number  of  reinforcers  per  component  during  VR  CRF.  The  lower  panel 
shows  the  total  keypecks  in  extinction  after  VR  reinforcement  for  each  extinction  series  as  a 
function  of  the  number  of  reinforcers  per  component  during  both  the  VR  VR  and  VR  CRF 
phases.  Each  panel  shows  the  data  points  for  all  extinction  series  except  those  not  meeting 
the  extinction  criterion  as  well  as  those  following  an  apparatus  failure  during  VR  CRF.  "r" 
is  Pearson's  r  and  "b"  is  the  slope  of  the  regression  line. 


Figure  8.  Total  responses  during  extinction  expressed  as  the  extinction  ratio  (ordinate)  for 
each  extinction  series  as  a  function  of  the  number  of  reinforcers  per  component  durina 
VR  CRF  (abscissa)  for  each  pigeon  (2374.  3 180.  3519.  2822.  2842.  2875  and  2880).  the 
dotted  line  at  1  on  the  ordinate  designates  no  FREE.  Values  greater  than  1  indicate  a 
FREE.  Values  less  than  1  indicate  a  reversed  FREE.  The  dashed  line  for  Figeons  3519 
and  3180  highlight  the  extinction  ratio  after  exposure  to  the  VR  VR  phase  only.  The 
asterisk  "*"  designates  the  termination  of  the  extinction  phase  before  reaching" the 
extinction  criterion.  The  plus  sign  "+"  designates  an  apparatus  failure  during  the  VR 
CRF  phase  of  the  extinction  series.  The  panel  labeled  "ALL"  shows  the  data  points  from 
the  individual  plots  except  those  not  meeting  the  extinction  criterion  as  well  as  those 
following  the  apparatus  failure  during  VR  CRF.  "r"  is  Fearson's  r  and  "b"  is  the  slope  of 
the  regression. 
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Figure  9.  Total  keypecks  during  extinction  expressed  as  the  extinction  ratio  (ordinate)  for 
each  extinction  series  as  a  function  of  the  number  of  reinforcers  per  component  during 
VR  CRF  (abscissa)  for  each  extinction  criterion.  "5  sessions"  equals  5  consecutive 
sessions  without  a  keypeck,  "1  session"  equals  1  session  without  a  kevpeck,  "1 
component"  equals  1  component  without  a  keypeck.  "Linked"  refers  to  the  requirement 
that  the  time-without-a-keypeck  criterion  occurred  for  both  extinction  components. 
"Unlinked"  refers  to  the  independent  assessment  of  the  extinction  criterion  between  the 
components.  The  solid  line  at  1  on  the  ordinate  designates  no  FREE,  "r"  is  Pearson's  r, 
"b"  is  the  slope  of  the  regression  line  and  "n"  equals  the  number  of  extinction  series  that 
met  the  extinction  criterion. 
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34 
multiple  schedule.  For  example,  a  linked  criterion  would  stipulate  that  a  response  could  not 
occur  for  5  consecutive  sessions  in  either  component  of  the  multiple  schedule.  An  unlinked 
criterion  would  be  the  termination  of  the  extinction  phase  for  each  component  separately. 
Thus,  once  an  extinction  criterion  was  met  in  the  first  component  of  a  two  component 
multiple  schedule,  responses  would  no  longer  be  counted  for  the  first  component,  but 
responses  for  the  second  component  would  continue  to  be  counted  until  the  extinction 
criterion  was  met  for  the  second  component.    Figure  9  shows  that  the  more  stringent  the 
extincfion  criterion  (i.e.,  longer  time  without  a  response  and  linked  to  both  components)  the 
stronger  the  correlation  between  the  exfinction  ratio  and  the  number  of  reinforcers  delivered 
during  VR  CRP. 

Extinction  performances  were  also  measured  in  terms  of  the  changes  in  response 
rate  as  the  log  proportions  of  the  response  rates  of  the  first  extinction  session  (Nevin, 
Smith,  &  Roberts,  1987).  Response  rates  generated  by  VR  reinforcement  were  usually 
higher  than  response  rates  produced  by  CRF.  Proportion  of  initial  extinction  responding 
was  used  to  adjust  for  these  initial  differences  produced  by  the  different  schedules  of 
reinforcement.  The  slopes  resulting  from  a  regression  analysis  (method  of  least  squares) 
were  used  to  calculate  the  rate  of  change  from  the  baseline  conditions.  The  smaller  the 
value  of  the  slope  (b)  the  greater  the  behavioral  momentum.  This  relationship  between  the 
slope  measure  and  behavioral  momentum  required  the  extinction  ratio  for  the  slopes  to  be 
in\'erted  (CRFA^R)  to  make  it  comparable  to  the  extinction  ratio  of  the  number  of  extinction 
responses  (see  above).  A  slope  extinction  ratio  of  1.00  indicates  no  FREE.  Values  greater 
than  1.00  indicate  a  FREE  and  values  less  than  1.00  indicate  a  reversed  FREE. 

Figure  10  shows  the  lineai-  regression  lines  fitted  to  the  log  proportion  data  for  two 
pigeons.  Figeon  2842,  series  4,  and  Figeon  3519,  series  1,  are  examples  of  the  reversed 
FREE  and  the  FREE,  respectively.  Included  in  each  panel  is  the  value  of  the  slope 
extinction  ratio. 
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Figure  1 1  shows  the  slope  extinction  ratio  for  log  proportions  as  a  function  of  the 
number  of  reinforcers  delivered  during  VR  CRP.  Data  from  all  the  pigeons  were  included 
except  for  Pigeons  2880  series  1  and  3519  series  4,  due  to  an  apparatus  failure  during  VR 
CRF  (see  method).  The  ratios  of  the  slopes  of  the  log  proportions  were  uncorrelated  with 
the  number  of  reinforcers  per  component  delivered  during  VR  CRF  (r  =  -.01 ),  but  the 
variability  in  the  slope  extinction  ratios  seemed  to  decrease  as  the  number  of  reinforcers  per 
component  during  VR  CRF  increased. 

Figure  12  shows  an  estimate  of  the  "savings"  in  the  number  of  keypecks  emitted 
during  extinction  by  implementing  CRF  after  VR  reinforcement  before  proceeding  with 
EXT.  The  measurement  for  this  analysis  was  derived  by  adding  the  number  of  keypecks 
emitted  during  extinction  after  the  CRF  histor}'  plus  the  number  of  keypecks  emitted  during 
the  CRF  component  of  the  VR  CRF  phase  (CRF  adjusted)  and  then  subtracting  the  number 
of  keypecks  emitted  during  extinction  after  the  VR  history  (CRF  adjusted  -  VR).  This 
measure  takes  into  account  the  number  of  keypecks  required  during  CRF  training  to 
produce  the  absolute  reduction  during  EXT.  The  measure  is  still  biased,  however,  in 
showing  a  "savings"  because  additional  VR  reinforcement  occurred  while  the  pigeon  was 
exposed  to  CRF.  A  zero  score  indicates  no  effect  of  the  CRF  schedule  in  increasing  or 
decreasing  the  number  of  keypecks  during  extinction  compared  to  extinction  after  VR 
reinforcement.  Values  greater  than  zero  indicate  an  increase  in  the  number  of  keypecks 
during  extinction  after  CRF  compared  to  extinction  after  VR  reinforcement.  Values  less 
than  zero  indicate  a  decrease  in  the  number  of  keypecks  during  extinction  after  CRF 
compared  to  extinction  after  VR  reinforcement.  The  results  showed  a  variable  effect. 
Extinction  performances  after  exposure  to  a  small  number  of  CRF  reinforcers  (0  to  40 
reinforcers)  showed  a  reduction  in  keypecking  during  EXT  after  CRF  by  as  much  as  1516 
keypecks,  but  also  produced  increases  in  keypecking  as  great  as  1390  keypecks.  Total 
keypecks  after  CRF  were  consistently  fewer  (i.e.,  by  127  to  4320)  when  CRF  lasted 
between  90  to  1550  reinforcers.  Only  one  of  the  four  extinction  series  in  which  the  number 
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of  CRP  reinforcers  was  greater  than  1 550  showed  a  reduction  in  keypecking  during  EXT 
when  keypecks  during  the  CRF  component  of  the  VR  CRF  phase  were  included. 
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Figure  10.  Individual  extinction  performances  (2842-4  and  3519-1)  expressed  as  the  log 
proportion  of  keypecks  per  minute  during  the  first  extinction  session  across  the  first  10 
sessions  of  the  extinction  phase  (abscissa).  Closed  circles  represent  extinction 
performances  after  VR.  Opened  circles  represent  extinction  performances  after  CRF. 
Regression  lines  were  fitted  by  the  method  of  least  squares.  Solid  lines  represent  the  slope 
of  tlie  extinction  performance  after  VR  and  dotted  lines  represent  the  slope  of  the  extinction 
performance  after  CRF.  The  numbers  in  the  upper  right  of  each  panel  are  the  value  of  the 
slope  extinction  ratio  (CRFA'R). 


Figure  1 1 .  Rate  of  keypecking  during  extinction  expressed  as  the  slope  extinction  ratio 
(CRFA^R)  of  the  log  proportion  as  a  function  of  the  number  of  reinforcers  per  component 
during  VR  CRF.  The  dashed  line  for  Pigeons  3519  and  3180  highlight  the  slope 
extinction  ratio  after  exposure  to  the  VR  VR  phase  only.  The  dotted  line  at  1  on  the 
ordinate  indicates  no  difference  in  the  slopes.  Values  greater  than  1  indicate  a  FREE. 
Values  less  than  1  indicate  a  reversed  FREE.  A  regression  line  (method  of  least  squares) 
was  fitted  the  slope  extinction  ratio  of  the  log  proportions  (solid  line). 
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Figure  12.  Total  keypecks  during  extinction  expressed  at  the  difference  between  keypecks 
after  VR  reinforcement  and  keypecks  after  CRF  plus  keypecks  during  the  CRF  component 
of  the  VR  CRF  phase  (i.e.,  CRF  adjusted  -  VR)  as  a  function  of  the  number  of  reinforcers 
per  component  during  VR  CRF.  The  dotted  line  at  zero  on  the  ordinate  designates  no 
difference  between  the  two  components  during  extinction.  Values  greater  than  zero  indicate 
more  absolute  keypecks  during  the  VR  history  component  compared  to  the  CRF  history 
component.  Values  less  than  zero  indicate  less  absolute  keypecks. 


DISCUSSION 

The  FREE,  as  measured  by  the  total  number  of  responses  during  extinction,  was 
replicated  both  within  and  between  subjects  using  a  single-subject,  free-operant 
experimental  design.  These  results  conflict  with  previous  attempts  at  generating  a  free- 
operant  within-subject  FREE  that  produced  reversed  FREEs  (Adams,  Nemeth,  &  Favlik. 
1982;  Favlik  &  Carlton,  1965;  Favlik,  Carlton,  Lehr,  &  Henrickson,  1967).  The 
difference  between  the  present  and  previous  attempts  at  producing  a  free  operant  within- 
subject  FREE  may  have  been  due  to  the  extensive  amount  of  exposure  to  the  schedules  of 
reinforcement  in  the  present  study  as  well  as  the  equating  of  the  number  of  reinforcers 
delivered  during  both  the  CRF  and  FRF  schedules. 

Equating  the  number  of  reinforcers  in  between-subject  experiments  has  not  been 
necessary  to  produce  the  FREE  (see  Jenkins  &  Stanley,  1950.  for  review).  The  extent  to 
which  the  FREE  can  be  produced  using  a  within-subject  procedure  without  equating  the 
number  of  reinforcers  presented  during  the  FRF  and  CRF  schedules  has  not  been  explicitly 
examined. 

Previous  research  exposing  subjects  to  different  amounts  of  reinforced  training 
(i.e.,  number  of  reinforcers)  has  shown  that  responding  during  extinction  persists  longer 
the  greater  the  number  of  reinforcer  presentations  (CRF,  Ferin,  1942;  Williams,  1938.  and 
FRF,  Hothersall,  1966).  Favlik,  Carlton  and  Manto  (1965)  compared  a  within-subject 
procedure  that  equated  the  number  of  responses  (60)  to  a  procedure  that  equated  the 
number  of  reinforcers  (40).  Both  procedures  produced  a  FREE,  but  the  procedure 
equating  the  number  of  reinforcers  produced  greater  total  extinction  responses  after  both  the 
CRF  and  VR  3  schedules  as  well  as  producing  a  larger  FREE  as  estimated  by  the  difference 
in  the  total  extinction  responses.  Although  it  may  not  be  necessary  to  equate  the  number  of 
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reinforcers  between  a  CRF  and  PRP  schedule  in  order  to  produce  a  within-subject  FREE, 
the  practice  of  equating  the  number  of  reinforcers  may  accentuate  the  FREE. 

The  production  of  the  FREE  with  a  single-subject  design  shows  that  the  analysis  of 
the  phenomenon  of  the  FREE  is  appropriate  at  the  level  of  individual  subjects.  Although 
the  FREE  was  consistently  produced,  several  issues  are  raised  when  a  single-subject 
design  is  used  to  investigate  a  behavioral  phenomenon.  The  first  of  these  issues  deals  with 
the  repeatability  of  the  phenomenon  in  a  single  subject.  Frevious  research  showed  that 
repeated  exposure  to  CRF  (40  reinforcers)  and  60  or  90  minutes  of  extinction  reduced  lever 
pressing  during  extinction  when  both  training  and  extinction  occurred  on  the  same  day 
(Bullock  &  Smith,  1953;  Clark  &  Taylor.  1960).    Bullock  (1960)  showed  that  intermittent 
schedules  (20  reinforcers  of  FRIO  or  Fixed  inter\'al  26  s)  also  showed  the  repeated- 
extinction  effect.  Wickens  and  Miles  (1954)  exposed  rats  to  training  (15  reinforcements) 
and  extinction  ( 1  hour)  on  alternate  days  and  reported  an  initial  increase  in  bar  pressing 
during  the  second  exposure  to  extinction  followed  by  a  slow  steady  decrease  during 
successive  replications  of  extinction.  Anger  and  Anger  (1976)  extended  the  training  phase 
to  two  days  (60  reinforcements)  and  the  extinction  phase  to  8  days  ( 100  trials  per  day)  and 
reported  no  reduction  in  total  number  of  keypecks  during  extinction  with  successive 
extinction  series  replications.  Anger  and  Anger  (1976)  did  see  a  repeated-extinction  effect 
when  they  limited  the  measurement  of  keypecking  to  the  first  extinction  session.  The 
repeated-extinction  effect  may  be  a  phenomenon  limited  to  the  early  part  of  extinction  that  is 
not  seen  when  data  are  summed  over  a  long  extinction  exposure  (e.g.,  8  daily  sessions). 

In  the  present  experiment,  total  keypecks  after  CRF  and  VR  and  the  extinction  ratio 
showed  no  consistent  repeated-exposure  effect  when  keypecking  was  carried  to  the 
extinction  criterion  (i.e..  5  consecutive  session  without  a  response).  In  an  analogous 
comparison  of  extinction  performance  during  the  early  part  of  the  extinction  phase  (Anger 
&  Anger,  1976),  total  keypecks  were  counted  for  the  first  extinction  session.  The  results 
were  the  same  as  when  keypecking  was  counted  over  the  entire  extinction  phase. 
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The  differences  in  the  effects  of  repeated-extinction  between  previous  research  and 
the  present  experiment  may  be  due  in  part  to  the  extensive  (e.g.,  months  of  daily  sessions) 
exposure  to  reinforcement  during  the  VR  VR  and  VR  CRF  phases  before  the 
reimplimentation  of  a  fairly  long  exposure  to  extinction.  One  result  of  particular  interest  is 
that  there  was  more  of  a  relationship  between  repeated-extinction  and  keypecks  during  the 
VR  component  than  there  was  during  the  CRF  component.  Changing  of  the  reinforcement 
schedules  between  the  VR  VR  and  VR  CRF  phases  may  have  acted  to  disrupt  the  stimulus 
control  that  could  be  produced  by  the  simple  alternation  between  a  single  reinforcement 
schedule  and  extinction. 

The  amount  and  type  of  retraining  necessary  to  minimize  the  effect  of  the  previous 
exposure  to  extinction  was  not  explicitly  examined  in  the  present  experiment.  The  results. 
however,  suggest  that  the  extinction  of  behavior  may  be  a  reversible  effect  if  the  organism 
is  exposed  to  multiple  reinforcement  schedules  in  the  presence  of  the  same  discriminative 
stimulus  for  an  extended  period  of  time  between  exposures  to  extinction. 

Previous  free-operant  research  exposing  subjects  to  either  CRF  (Margulies,  1961: 
Hearst,  1961;  Perin,  1942;  WiUiams,  1938)  or  PRF  (Hothersall,  1966;  Wilson,  1964) 
showed  that  as  the  number  of  reinforcers  during  acquisition  increased,  the  number  of 
responses  during  extinction  increased.  In  the  present  study,  the  extinction  ratio  showed  a 
strong  increasing  trend  as  the  number  of  reinforcers  per  component  during  VR  CRF 
increased.  Increases  in  the  total  number  of  keypecks  emitted  during  extinction  was  not 
replicated,  however.  The  number  of  responses  after  CRF  showed  a  weak  decreasing  trend 
as  the  number  of  CRF  reinforcers  during  VR  CRF  increased.  The  number  of  responses 
emitted  during  extinction  after  VR  reinforcement  showed  no  relationship  to  the  number  of 
reinforcers  presented  by  a  VR  schedule  during  the  VR  CRF  phase  or  to  the  number  of 
reinforcers  per  component  in  both  the  VR  VR  and  VR  CRF  phases  combined.  The  number 
of  reinforcer  presentations  in  previous  experiments  were  small  in  comparison  to  the  present 
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experiment  and  a  lack  of  a  replication  may  be  due  in  part  to  the  larger  parameter  values 
examined  in  the  present  experiment. 

The  lack  of  consistency  between  the  total  keypecks  measure  of  the  present 
experiment  and  the  number  of  responses  or  trials  in  previous  experiments  may  have  been 
due  to  the  use  of  the  multiple  schedule  in  the  present  experiment.  Exposing  individual 
subjects  to  both  VR  and  CRF  histories  of  reinforcement  may  have  produced  an  interaction 
between  the  two  schedules  of  reinforcement  (e.g.,  behavioral  contrast  or  induction).  To 
help  reduce  the  interactions  between  the  components,  the  keylight  and  houselight  were 
darkened  (i.e.,  1  min.  time-outs)  between  the  components.  The  darkened  keylight  was 
depressed  on  occasion  (e.g.,  about  once  or  twice  every  ten  sessions),  but  the  lack  of 
continued  and  persistent  responding  during  the  one  minute  time-out  inter\'al  reduces  the 
possibility  of  the  development  of  chained  responding  between  the  VR  and  CRF 
components  during  the  VR  CRF  phase. 

Interactions  could  also  have  been  detected  when  changing  from  VR  VR  to  VR 
CRF.  Changing  one  component  from  VR  to  CRF  consistently  decreased  the  "rate"  of 
responding,  more  accurately  described  as  average  reciprocal  latency,  for  the  CRF 
component.  The  effect  on  the  terminal  performance  of  the  VR  component  (e.g..  five  days 
before  the  initiation  of  the  EXT  EXT  phase)  was  varied  (see  Appendix  B).  Some  pigeons 
showed  consistent  increases  in  keypecking  rates  during  the  VR  component  when  CRF  was 
scheduled  in  the  alternate  component  (2374  and  2822),  or  consistent  decreases  (2880),  but 
most  of  the  pigeons  showed  varied  effects  (3519,  2875.  3180,  and  2842).  In  view  of 
these  results,  it  seems  unlikely  that  the  lack  of  an  effect  of  the  number  of  reinforcers  per 
component  during  VR  CRF  on  the  number  of  keypecks  during  extinction  was  due  to  an 
interaction  between  the  components. 

The  addition  of  an  extensive  training  regimen  (i.e.,  VR  VR)  before  the  presentation 
of  the  different  schedules  of  reinforcement  may  account  for  the  differences  between  the 
present  and  previous  experiments  that  did  not  incorporate  extensive  pretraining.  Hothersall 
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(1966)  assessed  the  role  of  CRP  pretraining  on  extinction  responding  after  maintaining 
behavior  on  a  VR  4  schedule  of  reinforcement  and  found  no  difference  between  groups 
exposed  directly  to  a  VR  4  schedule  after  response  shaping  (i.e..  no  pretraining)  and 
pretraining  with  10  CRF  reinforcers  before  exposure  to  a  VR  4  schedule.  Comparing 
groups  receiving  10,  50  or  100  pretraining  CRF  reinforcers  showed  that  the  50  and  100 
CRF  groups  emitted  fewer  responses  during  extinction  than  the  group  receiving  only  10 
CRF  reinforcers.  Groups  receiving  50  or  100  CRF  reinforcers  showed  no  differences 
during  extinction.  This  difference  in  total  responses  between  the  group  receiving  10  and 
groups  receiving  50  or  100  CRF  reinforcers  was  evident  even  after  200  reinforcers  were 
delivered  during  VR  4  schedule.  Hothersall's  results  showed  that  a  sufficient  amount  of 
exposure  to  a  previous  history  of  reinforcement  could  have  a  pronounced  affect  upon 
extinction  responding. 

The  present  procedure  exposed  each  pigeon  to  an  extensive  history  (see  Table  2)  of 
VR  reinforcement  as  pretraining  during  the  first  phase  of  each  series.  If  it  is  assumed  that 
the  relationship  between  the  number  of  PRF  reinforcers  and  the  number  of  responses 
emitted  during  extinction  is  an  increasing,  negatively  accelerating  function  that  approaches 
an  asymptote,  then  the  lack  of  an  increase  in  the  number  of  extinction  responses  after  VR 
reinforcement  could  be  attributed  to  the  large  number  of  reinforcers  delivered  during  the  VR 
schedule  during  both  the  VR  VR  and  VR  CRF  phases.  Examination  of  the  number  of  VR 
reinforcers  presented  during  the  component  paired  only  with  VR  reinforcement  showed  a 
highly  variable  but  flat  function  in  relation  to  the  number  of  keypecks  during  extinction  for 
the  component  previously  paired  with  VR  reinforcement.  These  results  suggest  that  the 
range  of  the  values  for  the  number  of  reinforcers  presented  under  a  VR  schedule  (200  to 
8750)  were  for  the  most  part  above  the  point  where  additional  reinforcement  presentations 
would  have  produced  additional  responses  during  extinction. 

The  decrease  in  extinction  responses  after  the  CRF  history  as  a  function  of  the 
number  of  reinforcers  per  component  during  the  CRF  VR  phase  could  also  be  explained  by 
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the  pretraining  history  of  VR  reinforcement.  If  CRF  produces  less  extinction  responding 
than  VR  reinforcement,  then  implementing  a  CRF  schedule  between  a  VR  schedule  and 
extinction  should  decrease  the  total  number  of  responses  emitted  during  extinction.  This 
effect  was  seen  in  the  total  number  of  keypecks  during  extinction  measure,  and  was  also 
represented  in  the  magnitude  measure  of  the  FREE  (i.e.,  the  extinction  ratio). 

The  interpretation  from  between-subject  procedures  examining  the  FREE  frequently 
has  been  based  upon  an  averaged  sample  of  performances  by  groups  of  subjects  (e.g., 
Adams.  Nemeth  &  Pavlik.  1982;  Amsel,  Rashotte  &  MacKinnon,  1966).  The  group 
averaging  of  individual  data  was  done,  in  part,  to  highlight  the  effects  of  the  independent 
variables  that  might  be  hidden  by  the  variability  produced  by  individual  differences. 
"Individual  differences"  is  still  a  relevant  issue  with  the  single-subject  design  concerning 
the  within-subject  replication  of  the  FREE.  Each  extinction  series  was  preceded  by  a 
unique  history  (e.g.,  none  or  a  number  of  previous  extinction  series).  One  way  to 
highlight  the  effects  of  potentially  relevant  independent  variables  that  might  be  hidden  by 
differences  between  individuals  and  replications  is  to  use  the  extinction  ratio  as  a  measure 
of  the  magnitude  of  the  FREE.  The  potential  utility  of  the  extinction  ratio  is  substantiated 
by  its  sensitivity  to  the  number  of  previous  reinforcers  per  component  during  VR  CRF. 
Whether  the  extinction  ratio  continues  to  be  a  useful  dependent  variable  will  depend  upon 
its  sensitivity  to  other  parametric  manipulations. 

The  slopes  of  the  log  proportion  were  highly  variable  from  condition  to  condition 
and  did  not  change  systematically  as  a  function  of  the  number  of  previous  reinforcers 
delivered  during  VR  CRF.  The  variability  of  the  log  proportion  measures  appeared  to 
decrease  as  the  number  of  reinforcers  per  component  during  VR  CRF  increased,  but  this 
observation  may  be  the  result  of  fewer  replications  of  the  extinction  series  at  large  values  of 
the  number  of  reinforcers  during  VR  CRF. 

Several  extinction  criteria  for  the  present  experiment  were  based  upon  arbitrary  but 
somewhat  natural  lines  of  fracture  (i.e..  1  component.  1  session,  or  5  sessions).  As  the 
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criterion  became  more  lenient  (i.e.,  less  continuous  time  without  a  response),  increased 
variability  was  observed  in  the  magnitude  measure  of  the  FREE  (i.e.,  the  extinction  ratio). 
Independent  (i.e.,  unlinked)  determination  of  "extinction"  between  the  components  also 
increased  the  variability  of  the  magnitude  measure.  These  results  suggest  that  part  of  the 
variability  reported  by  Williams  (1938).  Perin  (1942)  and  others  may  have  been  due  to  the 
premature  termination  of  the  extinction  procedure.  Until  there  is  a  more  thorough  analysis 
of  the  role  that  extinction  criteria  play  in  the  production  of  the  FREE,  criteria  based  upon 
time  without  a  response  should  be  fairly  consers'ative  (e.g.,  3  or  4  successive  20-min 
sessions)  and  be  tied  to  both  CRF  and  FRP  extinction  performances  to  equate  the  amount 
of  exposure  to  extinction. 

If  interpolated  CRF  is  effective  in  reducing  the  number  of  responses  emitted  during 
extinction  after  FRF,  the  implementation  of  CRF  before  EXT  could  be  a  useful  tool  in  the 
reduction  of  behavior  in  applied  settings.  The  results  from  the  present  experiment  suggest 
that  the  use  of  CRF  prior  to  EXT  when  behavior  has  been  previously  maintained  on  an 
intermittent  schedule  of  reinforcement  can  reduce  the  number  of  responses  emitted  during 
extinction.  Adjusting  for  the  number  of  responses  emitted  during  CRF  showed  that 
reductions  in  keypecking  during  extinction  were  consistently  produced  when  at  least  40  but 
fewer  than  1500  CRF  reinforcers  preceded  the  extinction  procedure. 

A  limitation  of  the  application  of  interpolated  CRF  to  the  reduction  of  behavior  via 
extinction  is  that  the  reinforcer  that  is  maintaining  the  target  behavior  is  not  always  known. 
A  few  experimenters  have  attempted  to  circumvent  this  problem  by  using  CRF  with  a 
known  reinforcer  before  implementing  extinction  (Foxx  &  McMorrow,  1983;  Neisworth, 
Hunt,  Gallop  &  Madle,  1985;  Schmid,  1986).  Although  responding  after  the  removal  of 
the  known  reinforcer  was  reduced,  the  effect  was  usually  temporary.  The  brevity  of  the 
effect  was  most  likely  due  to  the  continued  reinforcement  by  the  intermittent  schedule  that 
was  maintaining  the  behavior  before  the  introduction  of  the  known  reinforcer  (Wylie  & 
Grossmann,  1988). 
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The  present  experiment  illustrates  a  procedure  for  the  repeated  production  of  the 
FREE  within  a  single  organism.  It  seems  safe  to  conclude  from  the  results  of  the  present 
experiment  that  the  FREE  is  a  behavioral  process  (Sidman,  1960)  existing  at  the  level  of 
individual  organisms.  The  present  procedure  can  therefore  be  used  to  assess  a  range  of 
parameters  of  a  variety  of  independent  variables  on  a  continuous  measure  of  the  magnitude 
of  the  FREE  (i.e.,  the  extinction  ratio).  For  example,  the  present  experimental  procedure 
could  be  used  to  assess  more  accurately  the  effects  of  repeated  exposures  to  extinction.  If 
the  repeated-extinction  effect  is  minimal  (i.e.,  the  extinction  ratio  remains  unchanged)  a 
baseline  would  then  exist  to  test  a  range  of  stimulus  values  (e.g.,  drug  dosage)  on  behavior 
undergoing  extinction  using  a  single  organism. 

The  emphasis  of  future  single-subject  research  on  the  FREE  should  begin  by 
isolating  further  the  conditions  necessary  for  the  consistent  production  of  the  FREE  within 
the  single  organism.  Farametric  analysis  of  the  variables  that  might  contribute  to  the 
magnitude  of  the  FREE  (e.g.,  magnitude  of  reward,  deprivation,  different  kinds  of 
intermittent  schedules)  will  then  provide  the  necessary  foundation  on  which  to  build  the 
prediction,  control,  and  interpretation  necessary  for  a  more  complete  understanding  of  the 
FREE. 


APPENDIX  A 
COMPONENT  DURATIONS  (MIN)  DURING  EXTINCTION 
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5.21 

4.78 

3.94 
4.13 

4.70 
4.91 

1 

2.98 

2.98 

total 

14.90 

14.90 

total 

9.34 

9.28 

total 

22.53 

22.63 

total  18.85 

21.57 

2 

2.80 

2.80 

3 

1.82 

1.60 

3 

7.57 

7.57 

total 

14.00 

14.00 

1.57 

1.86 

total  37.85 

37.85  " 

2875 

VR 

CRF 

1.47 
1.23 

1.92 
1.79 

3    3.02 
total  15.10 

3.02 

1 

4.66 

4.67 

15.10 

1.18 

1.58 

4 

5.86 

5.86 

4.83 

5.54 

total 

29.30 

29.30 

6.38 

6.74 

4 

2.49 

2.49 

total 

7.27 

8.75 

6.39 

6.61 

total  12.45 

12.45 

4 

1.74 
8.70 

1.74 
8.70 

5    6.43 
total  32.15 

6.43 
32.15 

total 

22.26 

23.56  _ 

total 

2822 

VR 

CRF 

2 

1.05 

1.40 

5 

1.69 

1.69 

total 

5.25 

7.00  ■ 

1 

6.27 

6.73 

total 

8.45 

8.45 

6 

6.49 

6.49 

total  31.35 

33.65 

total  32.45 

32.45 

3 

1.11 

1.11 

6 

1.55 

1.55 

total 

5.55 

5.55 

2 

5.35 

5.35 

total 

7.75 

7.75 

total 

26.75 

26.75 

7 

1.59 

1.59 

total 

7.95 

7.95 
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APPENDIX  B 

STABE.ITY  AND  VARIABILITY  STATISTICS  OF  THE 

VR  VR  AND  VR  CRF  PHASES. 
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